Another look at Bootstrapping the Student 

t-statistic 



Miklos Csorgo* 1 , Yuliya V. Martsynyuk t 2 , and Masoud M. Nasari* 1 

1 School of Mathematics and Statistics, Carleton University, Ottawa, ON, Canada 
2 Department of Statistics, University of Manitoba, Winnipeg, MB, Canada 



Dedicated to the memory of Sdndor Csorgo 
Abstract 

Let X, X\,X2, . . . be a sequence of i.i.d. random variables with mean 
fi = EX. Let {yi , . . . , Vn be vectors of non-negative random vari- 

ables (weights), independent of the data sequence {X\,...,X n }%Li, and 
put m n = YJU Consider XI,..., X* m ^ , m n > 1, a bootstrap sam- 

ple, resulting from re-sampling or stochastically re-weighing a random sam- 
ple Xi, . . . , X n , n > 1. Put X n = Xj/n, the original sample mean, 
and define X*m n = Vj Xj/m n , the bootstrap sample mean. Thus, 
X*m n -Xn = E2=i(«i ) /m„-l/n)X i . Put U„ 2 = E?=iK-"V™«-lA0 2 and 
let S 2 ., respectively be the the original sample variance and the bootstrap 
sample variance. The main aim of this exposition is to study the asymptotic 
behavior of the bootstrapped i-statistics := (X* mn — X n ) j (S n V n ) and 
^m* := \J m ri(X*m n — X n ) j ' in terms of conditioning on the weights via 
assuming that, as n,m n — > oo, maxi<j<„(«| /m n — \/n) 2 /V% = o(l) almost 
surely or in probability on the probability space of the weights. This view 
of justifying the validity of the bootstrap is believed to be new. The need 
for it arises naturally in practice when exploring the nature of information 
contained in a random sample via re-sampling, for example. Conditioning on 
the data is also revisited for Efron's bootstrap weights under conditions on 
n, m n as n — > oo that differ from requiring m n /n to be in the interval (Ai, A2) 
with < Ai < A2 < 00 as in Mason and Shao [T3]- Also, the validity of the 
bootstrapped ^-intervals for both approaches to conditioning is established. 
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1 Introduction to the approach taken 

For throughout use, let X, Xi,X%, ... be a sequence of i.i.d. real valued 
random variables with mean /x := E(X). For a random sample X%, . . . , X n , 
n > 1, Efron's scheme of bootstrap, cf. [8J, is a procedure of re-sampling 
m n > 1 times with replacement from the original data in such a way that each 
Xi, 1 < i < n, is selected with probability 1/n at a time. The resulting sub- 
sample will be denoted by X*, . . . , X^ , m n > 1, and is called the bootstrap 
sample. The bootstrap partial sum is a stochastically re-weighted version of 
the original partial sum of X±, . . . , X n , i.e., 

m n n 

£x** = £ w ?°*' (i.i) 

i=\ i=l 

where, := # of times the index z is chosen in m n draws with replace- 
ment 

from 1, . . . , i, . . . , n of the indices of X l5 . . . , Xi, . . . , X„. 

Remark 1.1. In view of the preceding definition of , 1 < % < n, they 
form a row-wise independent triangular array of random variables such that 
Si<i<„ w< i n) = m n, and for each n>l, 

(wi, . . . , w^) £ multinomial (m n ; —,...,—), 

n n 

i.e., a multinomial distribution of size m n with respective probabilities 1/n. 
Clearly, for each n, wf 1 ^ are independent from the random sample Xi, 1 < 
i < n. Weights denoted by wf 1 ^ will stand for triangular multinomial random 
variables in this context throughout. 

The randomly weighted representation of Xa<j<m -^0* as ^ n P-1P - i n turn, 
enables one to think of bootstrap in a more general way in which the scheme 
of bootstrap is restricted to neither Efron's nor to re-sampling in general. 
In this exposition the term bootstrap will refer both to re-sampling, such as 
Efron's, as well as to stochastically re-weighing the sample. Both of these 
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schemes of bootstrap can be viewed and treated as weighted bootstraps. As 
such, throughout this paper, the notation v^ n \ 1 < i < n, will stand for 
bootstrap weights that are to be determined by the scheme of bootstrap in 
hand. Thus, to begin with, we consider a sequence {v^\ . . . , v^} n >i of 
vectors of non- negative random weights, independent of the the data sequence 
{X 1} . . . , X n } n > u and put m n = Y™ =1 % (n) , m n > 1. 

Consider now a bootstrap sample Xj", . . . , X*, m n > 1, which is a result of 
some weighted bootstrap via re-sampling or stochastically re-weighing the orig- 
inal random sample Xi, . . . ,X n , n > 1. Define the bootstrap sample mean 
Xm n := J27=i v Y ) ^-i.l m n an d the original sample mean X n := YH=\ Xi/n. In 
view of the above setup of bootstrap weights one can readily see that 



Hence, when studying bootstrapped t-statistics via {X^ — X n } n >i in the 
sequel, whenever convenient, we will assume without loss of generality that 
/i : = E(X) = 0. 

In particular, in this paper, the following two general forms of boot- 
strapped t-statistics will be considered. 



where S% and S^ n are respectively the original sample variance and the 
bootstrapped sample variance, i.e., 





(1.2) 




(1.3) 



n 



l<i<n 
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and 



S, 



77? 



Ki<m 



Remark 1.2. In £/ws exposition, bothT^ andT™ will be called bootstrapped 
versions of the well-known Student t-statistic 



Remark 1.3. In Efron's scheme of bootstrap vf 1 = w\ , 1 < i < n, and 
(CO]) is seen to be the well-known Efron bootstrapped t-statistic. When the pa- 
rameter of interest is fi = E(X), Weng JW] suggests the use o/J^Li QXi/m n , 
as an estimator of fx, where Q are i.i.d. Gamma(4, 1) random variables which 
are assumed to be independent from the random sample X{, 1 < % < n, and 
m n = Y17=i Ci- This approach is used in the so-called Bayesian bootstrap (cf., 
e.g., Rubin 115]). This scheme of bootstrap, in a more general form, shall be 
viewed in Corollaru \2.2\ below. 

The main objective of this exposition is to show that in the presence of 
the introduction of the extra randomness, vf 1 ^, as a result of re-sampling 
or re-weighing, conditional distributions of the bootstrapped ^-statistics 
and will asymptotically coincide with that of the original t-statistic T n . 
In this paper this problem will be studied by the means of two approaches to 
conditioning. In Section [2} we employ a new view to bootstrap via condition- 
ing on the bootstrap weights, u t - , 1 < i < n. As a consequence, a conditional 
central limit theorem (CLT) will be derived for T* and T** when EX 2 < oo 
(cf. Theorem 12. ip . It is then shown that the validity of Efron's scheme of 
bootstrap results directly from Theorem [2.11 (cf. Corollary 12. ip . As another 
example, in Corollary 12.21 the weights Q/m n , where Q are positive i.i.d. ran- 
dom variables independent of {JQ, l<i<n},n>l are considered for 
re-weighing the original sequence. It is shown that under appropriate mo- 
ment conditions for Q, the validity of bootstrapping the t-statistic T n via 
conditioning on Q, 1 < i < n, also follows from Theorem 12.11 In Section El 
we continue the investigation of the limiting conditional distribution of T™ n , 
but this time via conditioning on the sample X^ 1 < i < n, n > 1, and 
only for Efron's bootstrap scheme, on assuming that X is in the domain of 
attraction of the normal law {X G DAN) with EX 2 = oo (cf. Theorem 13. ip . 

The aim of weighted bootstrap via conditioning on the bootstrap weights 
as in Theorem 12.11 is to provide a scheme of bootstrapping that suites the 



X n - E(X) 



(1.4) 
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observations in hand. In other words, it specifies a method of re-weighing 
or re-sampling that leads to the same limit as that of the original t-statistic. 
This view of justifying the validity of the bootstrap is believed to be new. 
The need for it arises naturally in practice when exploring the nature of 
information contained in a random sample that is treated as a population, 
via re-sampling it, like as in Efron [8J, for example, or by re-weighing methods 
in general. 

In Section HJ we demonstrate the validity of the bootstrapped t-intervals 
for both approaches to conditioning. All the proofs are given in Section [5l 
Notations. Conditioning on the bootstrap weights and condition- 
ing on the data Xj, call for proper notations that distinguish the two ap- 
proaches. Hence, the notation {Six, J~x, Px) will stand for the probability 
space on which X, X%, X2, ■ ■ ■ are defined, while (Q V ,J- V ,P V ) will stand for 
the probability space on which the triangular arrays of the bootstrap weights 
Vi, {v^, v!p), . . . ,( v i ) ■ ■ • j ^i™')) • • • are defined. In view of the indepen- 
dence of these sets of random variables, jointly they live on the direct product 
probability space (Q x x ^v,J^x ® Fv,Px,v — Px x Pv)- Moreover, for use 
throughout, we let P\ v (.) be a short hand notation for the conditional proba- 
bility P(.|J r „) and, similarly, P.\x{-) will stand for the conditional probability 
P{\J~x)- In case of Efron's scheme of bootstrap, we will use w instead of v 
in all these notations whenever convenient. 

2 CLT via conditioning on the bootstrap weights 

In this section, the asymptotic behavior of the weighted bootstrap is explored 
via conditioning on the bootstrap weights. The major motivation for con- 
ditioning on the weights is that, when bootstrapping the i.i.d. observables 
X, Xi, X 2 , ■ ■ . should continue to be the prime source of variation and, hence, 
the random samples should be the main contributors to establishing condi- 
tional CLT's for the bootstrapped ^-statistics defined by (jl.2p and (jl.3p . The 
following Theorem 12.11 formulates the main approach of this paper to the 
area of weighted bootstrap. It amounts to concluding appropriate equivalent 
Lindeberg- Feller type CLT's respectively to both versions of the following 
statement: as n,m n — > 00, 
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M . _ max i< ^<» (It - IY f o(l) a.s. - P v 



.,(«) 



V™ ( v * - ir 

Theorem 2.1. Lei X, X 1; X 2 , . . . be real valued i.i.d. random variables with 

(n) 

mean and variance a 2 , and assume that < cr 2 < oo. Pit£ Vi n :— (— 

' I V Win 

±)X t |, 1< i < n, K 2 := 1 (— " i ) 2 , ^ := max ^'^ (fr~^ anrf / e * 

•=p n ( _i 1 ] 

Z be a standard normal random variable throughout. Then as, n } m n — > oo, 
having 



M n = o(l) a.s. - P v (2.1 
is equivalent to concluding the respective statements of (12. 2p and (12. 3p 
simultaneously as follows 

Px\v {T* ln <t) — > P(Z < t) a.s. - P v for allteR (2.2 
and 

max P x \v(y^ n / (S n V n ) > e) = o(l) a.s. - P„, /or a// e > 0, (2.3 

l<i<n 

and, in a similar vein, having 

M n = o Pv (l) (2.4 
is equivalent to concluding the respective statements of (12. 5p and (12. 6p 
as below simultaneously 

Px\v fC n <t) — > P{Z < t) in probability - P v for allteR (2.5 
and 

max Px\v{Vi,n/S n V n > e) = o P Jl), for all e > 0. (2.6 

l<i<n 

Moreover, assume that, as n,m n — > oo, we have for any e > 0, 



' o(l) a.s. -P v (2.7 



P X\v[ | ^ 11 > £ 



a 2 (zilL —\ 2 ' ' 1^(1). (2.8 

Then, as n,m n — > oo, via \2. 7\) . the statement of \2. 1\) is also equivalent to 
having li2.{J\) and li2.1(J\) simultaneously as below 
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Px\v {T™ n <t) — > P(Z < t) a.s. - P v for all t e E (2.9) 
and 

m^Px\v{Vi )n /{S^J^/nQ > e) = o(l) a.s. - P„, /or all e > 0, (2.10) 

and, m a similar vein, via 112.8]) . the statement \2.J$ is also equivalent to 
having 112.11]) and Ii2.12]) simultaneously as below 

Px\ v {T** n <t) — y P(Z < t) in probability - P v for all t e E (2.11) 
and 

maX n P xlv (V i!n /(S* m J^) >e) = o Pv (l), for all e > 0. (2.12) 

For verifying the technical conditions (12.71) and (12. 8ft as above, one does 
not need to know the actual finite value of a 2 . 

When the scheme of bootstrap is specified to be Efron's, then the following 
Corollary 12. II to Theorem 12 . 1 1 implies the validity of his scheme for both 
and T** as follows. 

Corollary 2.1. Consider v\ = w^, 1 < % < n, n > 1, and M n of Theorem 
\2.1\ in terms of these re-sampling weights as in Remark li.il i.e., Efron's 
scheme of bootstrap. Assume that < cr 2 = var(X) < oo. 

(a) If m n ,n —y oo, in such a way that m n = o(n 2 ), then, mutatis mutandis, 
\2. 4\ ) is equivalent to having l]2.5]) and 112.6]) simultaneously, and spelling out 
only ( Q£ 5]) . in this context it reads 

P x \ w { T m. n <t) — > P{Z < t) in probability - P w for all t G E, (2.13) 

(b) If m n ,n — y oo in such a way that m n = o(n 2 ) and n = o(m n ), then, 
mutatis mutandis again, {2.J$ is also equivalent to having 112.11]) and 112.12]) 
simultaneously, and spelling out only 112.11]) . in this context it reads as follows 

Px\w(T^ n <t) — y P(Z < t) in probability - P w , for all t E E. (2.14) 

Remark 2.1. It is noteworthy to note that, along the lines of the proof of 
the preceding corollary (cf. the second part of the proof of Lemma \5. 3\) . it 

2 

will be seen that for a finite number of observations X%, . . . , X n in hand, , 
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i.e., the bootstrap version of the sample variance S 2 , is an in probability-Px, w 
consistent estimator of S 2 as, only, m n =: m — > oo. In other words, when 
EX\ < oo, on taking n to be fixed as m n = m — )■ oo, we have that 



Sm n — >" S'n i n probability — Px,w (2.15) 

Remark 2.2. In probability- P w , part (b) of Corollary \2.1\ parallels (1.11) 
of Theorem 1.1 of Mason and Shao JW^ in which they conclude that, when 
EX 2 < oo, then for almost all realizations of the sample (i.e., for almost all 
samples), the conditional (on the data) distribution ofT™ n will coincide with 
the standard normal distribution whenever Ai < m n /n < A2 for all n large 
enough and some constants < Ai < A2 < 00. It would be desirable to have 
an a.s.-P w version of our Corollary \2.1\ and to extend the in probability— P w 
validity of its present form to having X G DAN with EX 2 = 00. 

Now suppose that 1^. = Q, 1 < % < n, where Q are positive i.i.d. random 
variables. In this case the bootstrapped t-statistic T* defined by (11.21) is of 
the form: 



< * v m n ' 



m n n 

T: = -J^-^^^ =) (2.16) 




where m n = Q. 

i=i 

The following Corollary 12.21 to Theorem 12.11 establishes the validity of 
this scheme of bootstrap for T*, as defined by (I2.16p . via conditioning on the 
latter bootstrap weights. 

Corollary 2.2. Assume that < a 2 = var(X) < 00, and let (1,(2, ■■■ 
be a sequence of positive i.i.d. random variables which are independent of 
X\, X 2 , ... . Then, as n —¥ 00, 

(a) if E^Q) < 00, then, mutatis mutandis, \2. 1\) is equivalent to having 
li2.2\) and li2.3\) simultaneously and, spelling out only li2.3\) . in this context it 
reads 

Px\d T n <t) — > P(Z < t) a.s. - P c , for all t G R, (2.17) 

(b) if E^((f) < 00, then, mutatis mutandis, \2. 4\ ) is equivalent \2. 5\) and 
112. 6\) simultaneously, and spelling out only 112.5]) . in this context it reads 

Px\t(T* <t) — ► P(Z < t) in probability - P c , for all t G R, (2.18) 
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where Z is a standard normal random variable. 



3 CLT via Conditioning on the sample 

Unlike the approach of conditioning on the bootstrap weights, which is be- 
lieved to be new as it was explored in Section [2J Efron's bootstrapped partial 
sums via conditioning on the data have been the subject of intensive study. 
Numerous remarkable papers in this regard can be found in the literature. 
Conditioning on the data which are assumed to be in the domain of attraction 
of the normal law, Hall [12J proved that if m n , n — > oo, and Ai < m n j n < X 2 , 
where < A x < A 2 < oo, then there exists a sequence of positive numbers 

{ln\n=l SUCn tnat 

V^(X* mn -JQ N ^ 1} . n probabiUty _ Px (31) 



In 

In the same year S. Csorgo and Mason [7J showed that under the same con- 
ditions as those assumed by Hall, i.e., X G DAN and m n /n G (Ai,A2) as 
before, the numerical constants 7 n in ( 13. II) can be replaced by the sample 
standard deviation S n , and the conclusion of (13.1 ft remains true. Further- 
more, Mason and Shao [13J replaced S n by the bootstrapped sample standard 
deviation and, under the conditions assumed by Hall |12j and S. Csorgo 
and Mason [TJ, they concluded that 

T m n N[0, 1) in probability - P x (3.2) 

if and only if X G DAN with EX 2 = oo. As mentioned already (cf. Remark 
12. 2p Mason and Shao [13] also characterized the almost sure-Px validity (nor- 
mality) of via conditioning on the data when their variance is positive 
and finite. 

Thus, via conditioning on the data which are in DAN, Mason and Shao 
[T3] established the validity in probability- Px of the Efron bootstrapped 
version of the t-statistics as in (jl.3p . as well as its almost sure— Px validity 
when EX 2 is positive and finite (cf. (1.11) of their Theorem 1.1). They 
also noted the desirability of having ( \3.2h holding true when the data are in 
DAN and m n = n. Theorem 13.21 below relates to this question in terms of 
(S* m JS n )TZ (cf. flSSD and Remark! 
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Remark 3.1. For a rich source of information on the topic of bootstrap we 
refer to the insightful survey by S. Csorgo and Rosalsky Jd$, in which various 
types of limit laws are studied for bootstrapped sums. 

Among those who explored weighted bootstrapped partial sums, we men- 
tion S. Csorgo [5J and Arenal-Gutierrez et al. [2] who studied the consistency 
(in Px) of partial sums via conditioning on the sample. Arenal-Gutierrez and 
Matran in |3J developed a technique by which they derived almost sure-Px 
conditional CLT for partial sums of i.i.d. random variables with a positive 
and finite variance, from the unconditional one. To prove the latter uncondi- 
tional CLT, they, in [3], used conditioning with respect to their weights first 
(cf. their weight conditions E1-E5 based Theorem 3.1 versus our Theorem 
12.11 and Corollaries 12.11 and 12 .2 j) . Clearly (cf., e.g., Lemma 1.2 of S. Csorgo 
and Rosalsky [6]), unconditional central limit theorems result from the con- 
ditional ones in P v or Px under their respective conditions, and, in turn, this 
is the way bootstrap works when taking repeated bootstrap samples (cf. our 
Section H|). S. Csorgo and Rosalsky [6j indicate that the laws of uncondi- 
tional bootstrap are "less frequently spelled out in the literature". Hall [11], 
however, addresses both conditional and unconditional laws for bootstrap. 
S. Csorgo and Rosalsky |5] also note that, according to Hall, conditional 
laws are of interest to statisticians who are interested in the probabilistic as- 
pects of the sample in hand, while the unconditional laws of bootstrap have 
the "classical frequency interpretation". Accordingly, and as noted already, 
our approach in Section [2] is that of a statistician interested in studying the 
probabilistic aspect of a sample that is treated as a population, by means of 
conditioning on re-sampling and/or re- weighing the data in hand. 

We wish to clearly point out that in this section only Efron's scheme of 
bootstrap will be considered. This is so, since the validity and establishment 
of the results here, to a large extent, rely on the multinomial structure of 
the random weights, in this scheme. On the other hand the data are 

assumed to be in DAN. We note that in this section only the case var(X) = 
oo is to be considered when X G DAN under conditions on n, m n , as n — > oo, 
that differ from requiring m n /n to be in the interval (Ai, A2) with < Ai < 
A2 < 00 as in Mason and Shao [T3] . 

It is well-known that the t-statistic converges in distribution to a standard 
normal random variable if and only if the data are in DAN (cf. Gine et 
al. [10]). The following Theorem 13.11 establishes the validity (asymptotic 
normality) of the Efron bootstrapped version of the t-statistics as in ( II. 3p . 
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based on X G DAN with an infinite variance via conditioning on the data. 
It is to be compared to Theorem 1.1 of Mason and Shao |T3] in the latter 
case. 

Theorem 3.1. Let X, X\, . . . be i.i.d. random variables with X G DAN and 
var(X) = oo. Consider as in M.3\) with Efron's bootstrap {w^ n \ 1 < i < 
n}, n > 1, scheme of re-sampling from random samples {Xi, 1 < i < n} n >i 
as in U.l\) and Remark \l.l[ If, as n, m n — >■ oo, we have that 

— y oo in probability — Px or, equivalentley, — 2 s> oo, 



2nS^\ogn ' "' v ' 2n£ x (n)\ogn 

(3.3) 

then, for all t G R, 

P w \x( T Z < *) — > P i Z < t) in probability- P x , (3.4) 

where £x{-) is a slowly varying function at infinity associated with X G DAN 
and Z is a standard normal random variable. 

The following result relates to Mason and Shao p3] asking the question 
wether or not ( 13. 4ft remains valid on taking m n = n, since in their condition 
that m n /n G (Ai,A2), one cannot have Ai = A2. According to the following 
Theorem 13.21 the answer is positive if one replaces T^* by 

(n) 

Y n (Hi i)x- 9* 

I m„,S n ■— ri / r— — ~C m„ • \ 6 - ) 

n l V n n 

Theorem 3.2. Let X, X\, . . . be i.i.d. random variables with X G DAN and 
var(X) = 00. Consider Efron's bootstrap scheme as in Theorem \3.1[ If, as 
n, m n — > 00, for arbitrary e > we have — > e > 0, then, for all t G R, 

P w \x{TZ,s n P(Z < t) m probability - P x , (3.6) 

where Z is a standard normal random variable. 

Remark 3.2. On taking m n = n, Theorem \ 3.S\ continues to hold true as 
before, but now in terms of 

c* 

n,S n c n • 
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4 Validity of Bootstrapped ^-intervals 



In order to establish an asymptotic confidence bound for // = E(X) with 
an asymptotic probability coverage of size a, < a < 1, using the classical 
CLT, one can use the classical Student pivot T n via setting T n < z a , where 
P(Z < z a ) = a. One can also establish an asymptotic size a bootstrap 
confidence bound for by taking B > 1 bootstrap sub-samples of size m n 
via re-sampling, or by generating B sets of stochastically reweighed boot- 
strap sub-samples of {X{, 1 < i < n} independently (i.e., each set of the B 
bootstrap weights are independent). The latter can be done by simulating 
B sets of independent i.i.d. weig hts (d (6) , . . . , Cn b) ), 1 < b < B. Obviously, 
the independence of the bootstrap weights with respect to the probability 
P v does not imply the independence of the thus generated sub-samples with 
respect to the joint distribution of the data and the bootstrap weights. One 
will have B values of T^ n (b) and/or T^* (b) or T*(b), 1 < b < B, and respec- 
tive asymptotic 100. a% bootstrap confidence bounds will result, as in the 
upcoming Theorems 14.11 and 14. 2\ from the inequalities 

T n <Ci B J, S = l,2,3,4 (4.1) 



inf {* : ^Ejccw <*)>«>> 

6=1 
1 B 

6=1 

1 B 

6=1 
1 B 

M{t: -J2nK(b)<t)>a}, 

6=1 

and T n is the Student t-statistic as in (jl.4p . 

Observe that Csfa, s = 1,2,3,4, are bootstrap estimations of the re- 
spective 100. a percentile of the distributions Px )V (T^ n < t), Px, v (T™ n < t), 
Px,v(T^ >Sn < t) and P x ,v{T* < t). Moreover, since C ( S B J are the lOO.a 



where 



(B) ._ 



MB) 
°2,a 



°4,a 
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percentiles of their respective empirical distributions, therefore they coin- 
cide with their respective order statistics T* , T* , T**% and T* , where 
l = [a(B + l)]. 

We note that C^, s = 1, 2, 3, 4, are natural extensions of S. Csorgo and 
Mason's [7J approach to establishing the validity of bootstrapped empirical 
processes. Some ideas that are used in the proofs of the results in this section 
were borrowed from [7J and adapted accordingly 

The objective of this section is to show that in the light of Theorems 
I2.1[ 13.11 and 13. 2\ the confidence bounds obtained from (14. ip will achieve the 
nominal coverage probability of a as n, m n and B — > oo. More precisely, 
in Theorem 14.11 below we consider the confidence bound as in ( 14.1 p and 
Efron's scheme of bootstrap, and show that the asymptotic nominal coverage 
probability a will be achieved. The latter will be shown to be true via 
conditioning on the bootstrap weights and also via conditioning on the data. 
In Theorem 14.21 we consider the confidence bound in ( 14. ip with C[ B J when 
the scheme of bootstrap is stochastically re-weighing and via conditioning 
on the bootstrap weights, we show that the asymptotic nominal coverage 
probability a will again be achieved. 

In order to state the just mentioned conclusions, one needs to define an 
appropriate probability space for accommodating the presence of B bootstrap 
sub-samples, as B — > oo. This means that one has to incorporate B i.i.d. 
sets of weights 

(v? (b) , (v® (b) , vf ] (b) ) , . . . , {vt ] (b) , . . . , # (b) ) , . . . ) , 

which live on their respective probability spaces (fl v ^), 3 v (b), Pv(b)), b > 1. In 
view of this, and due to the fact that n, m n and B will approach oo, we let 
^v(b), -Sv(b) j Pv(b)) be the probability space on which the 

following row-wise i.i.d. array of bootstrap weights are defined: 

^(l), ^ 2) (i),^ 2) (i)), (^ 3) (i),^ 3) (i),4 3) (i)), ... 

^(2), (t;! 2) (2),4 2) (2)), (^ 3) (2),^ 3) (2),4 3) (2)), ... 



In what follows, we let (0^ ^lx,v(b) , 0^=i $x,v(b) > P x,v(b)) be the joint 

probability space of the X's and the preceding array of the weights v(b), 
b > 1. 
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Theorem 4.1. Consider Efron's scheme of bootstrap, i.e., vf 1 = , 
1 < i < n, n > 1. 

foj Assume the conditions of Corollary \2.1\ Then, as n,m n ,B — > oo, 

oo 



c \Ji C 2,a — > z <* in probability - (x) P x , w (b) 



6=1 



f&j Assume the conditions of Theorems \3.1\ Then, as n,m n ,B — > oo, 



C2 „ — > z a in probability — (S?) P 



X,w(b)- 



6=1 



(c) Assume the conditions of Theorem \3.2\ Then, as n,m n ,B — > 00, 

00 

Cj} B J — > z a in probability - P x ,w(b)- 

6=1 

Theorem 4.2. Suppose that v\ = Q, 1 < % < n, and put m n = Y^=id- 
Assume the conditions of Corollaru \2.2\ Then, as n,B — )■ oo ; 

00 

t(B) 



Q, a — ^ ^ probability - Q£) Px,c(b)- 

6=1 

5 Proofs 

The proof of Theorem 12. II is based on the following Lemma I5TT1 that amounts 
to a realization of the Lindeberg-Feller CLT. 

Lemma 5.1. Let X,Xi, . . . be real valued i.i.d. random variables with mean 
and variance < cr 2 < 00 on (Q x ,$ x , P x ) , as before, and let {aj, n }™ =1 > 
n > 1 be a triangular array of real valued constants. Then, as n — > oo ; 

M n = T~ n 2 — » 0, (5.1) 

2^i=l a i,n 

i/ and on/?/ ?/ 

Ei =i a »,n^i _^ ]V(o, l),and, /or a// e > 0, max P x ( — l a »>" X »l > £ ) 

l\—\n 2 Ki<n /v^ n 2 

(5.2) 
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or, equivalently, if and only if 

Z^ =l a %,n Xi_ _^ j,^ ^ £ > Q ? max p / \ a i,nX l \ > £ ) 0, 

q r\^ n 2 l<j<n q r\^ n 2 



(5-3) 

where N(0, 1) stands for a standard normal random variable, and S n is the 
sample variance of the first n > 1 of the mean and variance a 2 i.i.d. 
sequence X, X\, X2, ■ ■ ■ of random variables. 

Proof of Lemma 15.11 

The equivalence of the respective two statements of (15.21) and (I5.3P is an im- 
mediate consequence of Slutsky's theorem via having S 2 — > a 2 in probability 
as n —7- 00. Hence, it suffices to establish the equivalence of the statement 
(15.1 p to the two simultaneous statements of ( 15. 2 p . 

First assume that we have (15. ip and show that it implies Lindeberg's 
conditions that in our context reads as follows: with F(x) = Px{X < x), 

1 - f 

L n (e) := 2- VaJ n / x 2 dF(x) -> (5.4) 

°~ 2^=1 a i,n i=1 J(\ai, n x\> £ a^/Z?=i <J 

for each e > 0, as n — > 00. Now observe that L n {e) can be bounded above 
by 



a 2 



[ AF W ^0,q s ,woo, (55) 

J(\x\>eaJ ^=1^." ) 

™Ki<n »;„ 



on assuming (15. ip and i?X 2 = J x 2 dF(x), i.e., (15. ip implies (15.41) . The 
latter, in turn, implies the Lindeberg CLT statement of (15. 2p . Moreover, by 
Chebeshev's inequality, via (15. ip we conclude also the second, the so-called 
uniform asymptotic uniform negligibility condition statement of (15. 2p . Thus, 
we now have that (15. ip implies (15. 2p . 

Conversely, on assuming now (15. 2p . its Lindeberg- Feller type simultaneous 
conclusions imply the Lindeberg condition of (15. 4p . as per the Lindeberg- 
Feller CLT, and (J53D yields Q£T). □ 

Proof of Theorem 12.11 

In view of Lemma 15. 1[ the a.s.-P„ equivalence of (12. ip to ( I2.2p - (l2.3p and, 
via (1277]) . that of Q2HJ) to (123]) - (1^TU|) hold true along a set N G $ v with 
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P V (N) = 1. 

As for the in probability- P v equivalence of ( 12. 4p to (I2.5p - (l2.6p and, via 
(]2.8p . also to (I2.lip - fl2.12p . they hold true via the characterization of con- 
vergence in probability in terms of a.s. convergence of subsequences. Ac- 
cordingly, for each subsequence {nk} k of n, n > 1, there exists a further 
subsequence {ni Ce } e along which, as £ — > oo, by virtue of Lemma 15.11 the 
latter two in probability- P v equivalencies reduce to appropriate a.s.-P„ equiv- 
alences. This also completes the proof of Theorem 12.11 □ 



Proof of Corollary 12.11 

Here the bootstrap weights = w\ n \ 1 < i < n, n > 1, are as in Remark 
11.11 i- e -> f° r each n > 1, 

(w^, . . . , w^) £ multinomial (m n , —,...,—) 



n n' ' 



with m n = XliLi w l ■ m v i ew °f Theorem 12.11 P ar t ( a ) of Corollary 12 . 1 1 will 
follow from the following Lemma I5.2[ and Lemmas 15.21 and 15.31 together will 
conclude part (b). □ 

We now state and prove Lemmas 15.21 and Lemma 15.31 

Lemma 5.2. Consider Efron's scheme of bootstrap and assume that a 2 = 
var(X) < oo. Ifm n ,n — >■ oo in such a way that m n = o(n 2 ), then, 

(n) o 
/W. 1 \ 2, 

max!<j< n \-± -) 

M n = > in probability — P w . 

Z-/i=l \ m n n) 

Lemma 5.3. Consider Efron's scheme of bootstrap and assume that < 
a 2 = var(X) < oo. As m n , n — >■ oo in such a way that m n = o(n 2 ) and 
n = o{m n ), then, 

Px\w ( —(—) 1 >£)—»• in probability — P w . 

t—'i=\ \ m n nJ 
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Proof of Lemma 15.21 



In order to prove this lemma, for e, e' > 0, we write: 

„(») ,>2 



-'■"'V (n) o ^ L ) 

y^n /M>^ _ j_\2 
Z—/i=l \ m n n) 



(n) rj 

< pj maxi ^ n ^ " J > e , |J\r _ I) 2 _ ii < £ >) 



m„ 



n ( n ) 1 



^(It^kF (— --) -i|>0 

v n' i— 1 " 

i<i<n v m„ n m n 



n (n) 



(i-i),. ^'(i 



m n n m n 1 m r , 

i=i 



+ ^(IE(— --) -^^l> 

1=1 

=:Li(n) +L 2 (n). 
An upper bound for Li(n) is: 



lll n 



m n n 1 V m n 

e{l - e'){l - 



2(^ + Js(l -e>){l -I)) 



The preceding relation, which is due to Bernstien's inequality, is a general 
term of a finite series when m n = 0(n 2 ). 

As for Z/2 (n), we first note that for each i, 1 < z < n, 

?;; (n) 1 ?;; (n) 1 fl - iN ) 

^(^- " -) 2 = - -) 2 = ^— < 

m n n m n n nm n 

We now employ Chebeshev's inequality to bound L 2 (n) above as follows. 
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Loin) < 



2 n (n) -, it 1* 

mi „ ,w\ 1, 2 (1-- 



e' 2 (l- 


1)2 






£ /2 (l- 


1)2 






m 2 




£ /2 (l- 


1)2 

n 1 



m„ n m 



a. 



i=l 

» i s <?, a _ i\2. 



b.(E( 



m 2 (i-i) 



m„ n' / m 2 



n 



( n ) 1 ( n ) 1 ( n ) i 



m„ n 



) 2 (^--) 2 ) 



(1 — - 

m 2 



In view of the fact that w\ , 1 < i < n have multinomial distribution, 



,(«) 
i ' 

after computing E w \(wi ) a (w2 ) b ] , where a, b are two integers such that 
< a, b < 2, followed by some algebra, we can bound the preceding term by 

ml r(l-j) | (l-^) 4 | (m w -l)(l-l) 2 | 4 (n-l) 



1)2 { 



£ /2 (l — i) 2 I n 3 ml ml nml n 3 m T: 

1 1 n-1 4(n-l) (1-i) 2 

o 000 



m 2 nm 2 n 3 m 2 
1 r4m„ 1 1 



n 2 ml 


ml 


1 


4 1 


- + — 




n z 


nm n J 



e' 2 I n 2 n 3 m n m n 

where a n ~ b n stands for the asymptotic equivalence of numerical sequences 
a n and b n . 

Clearly, as n,m n — > 00, the preceding relation approaches zero when 
m n = o(n 2 ). Now the proof of Lemma [5.21 is complete. □ 

Proof of Lemma 15.31 

For £1, £ 2 , £ 3 > we have, 

P w {Px\J\ '— ; - 1 > £ i) > S2 ) 

v a 2 ' _ I) 2 J 

= p„({px\J^ — 2 1 > > ^ 
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o*2 ( n ) ■> 



n n (n) -, 

+ ^(Eln^E(^- i ) 2 -i|>^ 

' (1 — — ) z — ' m n n 1 7 

< p„(^(|«L _ ff> _ I)>| > ^-'M-ih > £2 ) 

V 1 m n L — ' m n n 1 m n / 

2=1 

n n (n) 



--:ti(n)+t 2 (n) 



We note that along the lines of the proof of Lemma 15.21 it was already shown 
that, when m n = o(n 2 ), as n — > oo, then t2(n) — > 0. 

To show that ti(n) — > 0, as n — > oo, we proceed as follows. 



ilW <P 4 P x| ^|S_^| > 2Mzf 2 K^i) )> | ) 



m n m n m n / 3 

+ p /jVi CU (^T-^) 2 -^-^ ! > £i(l-£ 3 )(l-^) \ > £2x 
w ^ v m n ' m n / 3 

Now from the [/-statistic representation of the sample variance we have that 

^(n)^(n) 

s£. - ^ = EE ( m " (m "_ i) - ^rzi) ) - ^) 2 - 



Therefore, (n) can be bounded above by 

(ra) (n) ., 

, Wj- 'wj 1 

'm n {m n — 1) n{n — l) /v ' J/ 1 1 "" n 



(n) (ra) 

E E( W ( Wj u ~ ~r-r^ Xi ~ > ^ ~ e *W - -)) > I) 

x ^— ' ^— ' m m — I ii n — I 1 n 7 7 
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(n) (n) 

< ^(^[«(1EE( / ' n - "T^-n)^ - x ^ 2 l) > ^ " ^ 

\ \\ 771 — 1 f!H-l V 

(n) (n) 

v ^ ^ 1 m n (m n — 1) ri(n — l) 1 n 

( n ) ( n ) 1 1 

^ P «(EEI 1 - TT ~ -T^-nl > - £ 3)(l - )• 

v 1 m„ (m„ — 1 n(n— 1)' n 6 

For ease of notation we set £„ := £i(l — £s)(l — Using this, the 

preceding term can be bounded above by 



(n) (n) i 

n (n-1 — i — —^-- ( TT 

L m„{m„ — I) n (n — 1 



"m n (m n — 1) n(n — 1)' 

(n) (n) -, (n) (n) -, 

+ n(n - l)(n - 2)£ w -± — 7 f A - — - 

V m n (m n — 1) n(n — 1) m n ym n — 1) n{n — 1) v 

(n) (n) -i (n) (n) , 

, „ /, W ID, 1 I I Wo Wa ] 

+ n(n - I n - 2)(n - 3 £j 7 — r 7 r j — — 

\'m n (m n — 1) n(n — 1) m n (m n — 1) n(n 

(n) fn) 1 



< e n - 2 {n(n - 1)E W ( 7 W2 - -^-) 

(n) in) -, 

+ n n _ 1 n _ 2 )E W ( 1 2 - 

v m n (m n — 1) n(n — 1) 

(n) (n) -, 

+ n(n - l)(n - 2)(n - 3)^( ^ W2 - -y^) 2 } 

m n {m n — 1) n(n — 1) J 

2 ^3 „4 



„ -2 



_ n n n { ^ 

I n 2 m\ n 2 m 2 l n 2 m 2 n 



The preceding conclusion, which implies that t[ (n) — >■ 0, is true since, as 
n — ?• 00, e n — >• £i(l — £3)^ and n = o{m n ) by assumption, as n,m n — > 00. 
Moreover, we note that the preceding convergence to also takes place when 
n, the number of the original observations, is fixed and m n := m — > 00 (cf. 
Remark [271]). 
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To show Q (n) — > 0, as n — > oo, we note that 

t? < P w {Px(\Sl - a 2 | > a%(l - e 8 )(l - > f ) 

0. 



< 3e 2 - ^ (|S 2 - a 2 | > a 2 £l (l - e 3 )(l - ±)} 
To deal with t\ (n), we observe that it can be bounded above by 



Once again we note that during the proof of Lemma 15.21 it was shown that 
when m n = o(n 2 ), as n — > oo, the preceding term approaches zero, i.e., 
tf\n) 0. We now conclude that, as n — > oo, ti(n) — > 0, and the latter 
also completes the proof of Lemma 15.31 □ 

Proof of Corollary 12^1 

Recall that m n := YH=i d = n ^ = n C- I 11 view of Theorem 12. 1[ the proof of 
parts (a) and (b) of Corollary 12.21 will result from showing that, asn-> oo, 



, f maxKK^^ - I) 2 f (i) a .s. - P c when E c ((f) < oo (5.6) 
" Er=i(^-^) 2 \o P( (l)whenE c (Cl)<oo. (5.7) 

Since Q's are positive random variables, we have 

max 1<4 <n(J- - \ f 

_ maxi< i < w (Ct ~ Cn) 2 

Xa<i<n(C« ~~ Cn) 2 

In view of Kolmogorov's strong law of large numbers, when E^((f) < oo, we 
have that, as n — > oo, 



J^(Ci - Cn) 2 / « -> uar(&) a.s. - P ? . 



i=l 
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Also, 

maxi<j< n |Ci — Cn\ < 2 maxi<j< n Q 
y/n ~ yfn ° 

Therefore, to prove parts (a) and (b) of Corollary (12. 2p , it suffices to, respec- 
tively, show that, as n — > oo, 

maxKKn (, J o(l) a.s. — when E^((f) < 00 (5.8) 
~ 1 o Pc (f) when E c (Ci) < 00. (5.9) 

To establish (15. 8ft . for e > 0, we write 
00 00 
$> P c (Ci > eV") < X>c{Ci 2 /(ICi| > 

n=l n=l 

00 fc 

= ££tf c {C?J(eV* < Ci < eVk + 1)} 

k=l n=l 

oo 

<J2 k E c {tfl{eVk> < Ci < £VTTl) } 
fc=i 

n 

< ^ £ c {tf/(e>/fc < Ci < e\/k + T) } 

k=l 

= eE ( ((l) <oo. 
In order to prove (15. 9p for e > 0, we continue as follows. 

nP ( (Ci > ey/n) < e~ 2 i? c (Ci/(Ci > — > 0, as n ^ 00. 
This also completes the proof of (15. 9 \ and that of Corollary 12.21 □ 

Proof of Theorem 13.11 and Theorem 13.21 

We first proof Theorem 13.21 

Proof of Theorem 13.21 

In order to prove this theorem, first define 
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Recall that (w^ , . . . , w„ )£mmtmomial(m n , -,...,-) for each n > 1. Hence, 
by virtue of Corollary 4.1 of [H], conditioning on the data, (fj,) is a prop- 
er/?/ normalized linear function of w^, . . . , . The term properly normal- 
ized is used since 



E^x((5s- - -) w - ,)) - i). 

i=l i=l 



The latter normalizing sequence is that of the CLT of Corollary 4.1 of [14J. 

It will be first shown that the conditions under which Corollary 4.1 of 
Morris [H] holds true are satisfied in probability Px- Then, by making use of 
the characterization of convergence in probability by almost sure convergence 
of subsequences, it will be concluded that for each subsequence {ni\t of 
{n}^L 1; there is a further subsequence {n£ s } s , along which, from Corollary 4.1 
of Morris p3], (//), conditionally on the sample, converges in distribution 
to standard normal a.s.— Px- The latter means that, Vt G R 

P w \x{T^ n {fi) < t) -»■ P(Z < t) in in probability - P x , (5.10) 

where Z £ JV(0, 1). 

The conditions of Corollary 4.1 of Morris [14J are satisfied, for one has 

(a) — > e > 0, since n m . , > +oo (cf. 03.3p j. 

n 2ni 2 (n)logn 



(b) max ( —) — > 0, as n — > oo, 

l<i<n \n/ 



max var w \x((— )(Xi — a)) max (Xj — a) 2 

, \ l<i<n 1 v m n n ' l<i<n „ . , 

(c) — ^ = — ► m probability - 

,w) 1. 



i=l 

Px- 



m„ n 

i=i n i=i 
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Conclusion (c) is a characterization of X G DAN (cf., e.g., [10J). In view of 
(a), (b) and (c), one can conclude that (I5.1UP holds true. 
Now observe that for T* s , as defined in (I3.5p . we have 



Via Slutsky's theorem in probability— Px, one will have, V£ G R, as 
n, m n — > oo as in (13. 3p 

P w \x(T^s n < *) — > P(Z < t) in probability - P x , (5.11) 
if it is shown that, for e±, 62 > 0, as n — > 00, 

Px(P w \x(\S 2 n - Etl(X n l ~ ^ \ > ei) > e 2 ) -> 0. 
This in turn is true, since 

Px(P w \x(\S 2 n - £"=i^-^ 2 | > ei ) > £2 ) 

= ^(/(|^- ^f^ l> ei )> ea ) 

<e 2 - 1 P x (|^- ^ l( ^~ /i)2 | > £l ) ->0, asn^oo. 

The preceding relation is due to Raikov's theorem (cf., e.g., [10]). Hence 
( 15. lip is valid, and the proof of Theorem 13.21 is complete. □ 

Proof of Theorem 13.11 

Due to Slutsky's theorem in probability— Px, Theorem 13.11 will follow if one 

shows that, for e > 0, as n, m n — > 00 as in (13. 3p . we have 

P w \x(\s£ n - Sl\ > £1) ->■ in probability - P x . (5.12) 
For S*? and we write 



- ^ C^* ^i) _ w TT X! (^« ^i) 

rr ' n n(n — 1) 



nK _ !) x< 
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To establish (I5.12p . for £i,£2 and £3 > 0, on using the above ^/-statistic 
representations, we have 

Px{P w \x{\S* mn - Sl\ > £1) > e 2 } 

w (n) w {n) 1 e 3 

< Px{Pw\x[ - > £1, n 1 — j — — — — - < 

l<i^j'<n 



rn n (m n — 1) n 2 n 2 £ 2 (n) y/log n 



(n) (n) ., 

j/p C II I w * H 1 u 63 w g2 ] 

1 "' v U 'm^m^-l) n 2 ' n 2 £ 2 (n)v4oi^ ; 2 J 



- n I n 2 £ 2 (n)^hgH s 3 } 2 ' 

(n) (n) . 

+j/p( || I w * w s _1|> f! )>£ii 

!<]#<„ W™» - 1) n 21 r2 2 £ 2 (n)v^oi^ ; 2 J 

— n 2 £ 2 {n)^\ogn 2e 3 

n ( n ) ( n ) 1 

+^( U I^1T-^I> E3 ^ 

p„ » 1 ^ ^ — n z 1 



£2 K^ <n m n(m n . - 1) n 21 n 2 £ 2 {n)^\ogn ! 
= o(l). 

The relation (15 . 1 3[) is due to the fact that X G DAN, and an application 
of Bernstien's inequality for wf^Wj^, viewed as Y^i<s< mn (m n -i) I (X<» = -0> 
where, Y s , 1 < s < m n (m n — 1), are i.i.d. random variables which are 
uniformly distributed on the set {1, . . . , n 2 }. □ 

Proof of Theorem 14.11 

Observe that, as n, m n approach infinity, the asymptotic equivalence of S^ n (b) / m n, 

! ^ _ 2 ff2 „ _ jva cond ._ 

^— 'i=l V m„ nl ^—i%=Y \ rn n nl 1 

tional probability Px\wi f° r each 1 < b < B, yields asymptotic equivalence 
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for T* (b), IT (6) and T* (b), where the latter is defined by 



Therefore, we only give the proof of this theorem for CT and its associated 
bootstrapped quantile which is defined by 



Cg?:=inf{t: ^ f>(^ n >) < *) > «}■ 



6=1 

In other words, we shall show that, as n,m n , B — > oo, we have 



C^J — > z a in probability — (X) -Px 



>(&)■ 



To do so, we first note that in view of the asymptotic normality of T* a (b), for 
each 1 < b < B, one can conclude the asymptotic conditional independence 
of T^ n>a (b) and T^ n>a (b') for each 1 < b ^ b' < B, from the fact that 
conditionally they are asymptotically uncorrelated. The latter is established 
in the following Lemma [5.41 



Lemma 5.4. Assume the conditions of Theorem \4-l\ As n,m n — > oo, for 
each 1 < b ^ V < B, we have 

E(T* mn Jb) T* m ^{b')\(w { ?\b\ . . .M:\b)h (wf\b% . . .M:\b'))) a.s. P w . 
Proof of Lemma 15.41 

For ease of notation, we let E\b(.) and E^y(.) be the respective short hand 
notations for the conditional expectations . |(w| n ^(6), . . . , wi n ' ) (6))j and 

E[.\(w^(b),...,w^(b)), 

(u^(6') , . . . , u4™' ) . Similarly, we let P|&(.) and stand for the 

conditional probabilities p(^ . | (u»| n ^(6), . . . , w^\b)) j and . | (u^(&), . . . , u4™' ) 
(w^^fo'), . . . , w^\b')) j , respectively. 
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Now observe that from the independence of the Xj's, we conclude that 

Z? ( T* fh\ T* £—'i=\ \ m n n)\m n n) 

Ex\b,b'{T mnj(T (b) T [b)) = . 

V £—/k=l V m n n/ V £—'l=\ V ro n n/ 

By this, with £1, £2 arid £3 > 0, we can write 
p(\E w (T^ n Jb) T,l^(b'))\ > ei ) 

V(l — ^) ~^ rn n n m n n 1 / 
\ (1 — —) z — ' v m„ n / 

v n y i=l Tl 

+^fi^i:(^- 1 ) 2 -ii>^. 

V 1 1 - I ^ v m n n> 1 / 

V n> i=l n 

The last two terms in the preceding relation have already been shown to 
approach zero as — > 0. We now show that the first term approaches zero 
as well in view of the following argument which relies on the facts that w^ n \ 
1 < i < n are multinoialy distributed and that for each 1 < i, j < n, w^ n \b) 
and wf ] (b') are i.i.d.'s (in terms of P w ) when b ^ b' . 

In what will follow, for the ease of notation we put e 4 := ej(l — e 2 )(l —£3)- 

( ^_i )( ^_i)| >ei) 

<- ^ 2 A{nEl(^> - V + n(n - \(^> 1)1 } 

(1 — -) z L m n n l m n n m n n \) 

— J ^ nirin m n n 2 ) 

Now the proof of Lemma 15.41 is complete. □ 
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as n, m n , B — > oo 



We now continue the proof of Theorem 14. II by showing that for any e > 0, 

Px M b) (CiS < *<* - e) ->• 0, (5.14) 
^)K )>2 «+ e )^°- ( 5 - 15 ) 



6=1 



Observe that we have 

oo ^ S 

' P*,„<6) (Cg> < ^ - e) < <g) Px,«(6) (-^ E J ( T ™,^( & ) <za-e)>a) 

(5.16) 



6=1 



6=1 



and 



oo j B 

(CgJ > + 5) < (g) P XMb) ( - E I(T^ a (b) < z a + e) < a). 

6=1 6=1 

(5.17) 

In view of ( 15. 1 6[) and (I5.17p . the relations ( 15 . 14[) and (I5.15P will follow if for 

each a£E, one shows that, as n, m n , B — > oo, 

1 B 

Px M b){~5 E l J CO) < a) - $ («)| > £ ) 0. ( 5 - 18 ) 



6=1 



6=1 



where $(.) is the standard normal distribution function. 
To establish (15.1 8ft . we write 



1 B 



6=1 



6=1 



6=1 6=1 
6=1 

+ E {]p E [( J ( T ^( & ) ^ «) - WCatfO < «) - $ (°))] } 



1<6^6'<B 
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< i + S{^| lf2 [(/(T* n;(T (l) < a) - *(o)) (/(T; ni(7 (2) < o) - $ (a))] } 



—7- 0, as n, m n , 5 — > oo. 



The preceding relation is true since, in view of Lemma 15.41 for large enough 
n, m n we have that 

e{e x]1 , 2 [(1(7^,(1) < a) - W^(2) < o) - *(o))] } 

« JSlj^n (1(2^^(1) < o) - $(a)} £{£ X | 2 (7(7^(2) < a) - $(a))} 

= £?{p X |i(^(l) < a) - *(a)} /5{Px| 2 (T;, iiCT (2) < a) - $(a)} 
— > 0, as n, m n — )■ oo. 

The preceding relation is due to part (a) of Corollary 12. 1[ with cr 2 replacing 
S" 2 therein, and the dominated convergence theorem. Now the proof of part 
(a) of Theorem 14.11 is complete. 

To prove parts (b) and (c), we first conclude the asymptotic in probability 
equivalence of T™ n and T^ n , as n,m n — > oo, in terms of the conditional 
probability P w \x (cf. the proof of Theorem 13. ip . The same equivalence holds 
true between T^ n Sn and by virtue of Theorem 13.21 (cf. the proof of 

Theorem I3.2p . Therefore, parts (b) and (c) will follow if we show that, as 
n, m n , B — y oo, 



C i B d — ► z a in probability - r x .„ ,.,,„. 



where Cj^2 '■= inf{t : ^&=i ^(T^ (6) — t) — a }- To do so, similarly to 
what we did in the proof of part (a), we shall show that for any e > 0, as 
n, m n , B oo, we have 



(5.19) 



and 



(5.20) 
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Now observe that 

oo ^ B 

Px M b) MS < z* ~ e) < (g) Px^(6) (■£ E < ^ - e) > a) 

(5.21) 



6=1 

and 



6=1 



6=1 



6=1 



oo j B 

^(6) (Cg? > + e) < (g) ^(6) ( ^ E HTLA b ) ^ z « + £ ) < a ) ■ 

6=1 6=1 

(5.22) 

In view of < KT\} and fl5T22|) . the relations f l5~T9|) and fl5T20|) will follow if for 

each a e R, one shows that, as n, m n , B — > oo, 



1 B 

Px M b){z E I J ( T -..m( & ) ^ a) - $ («)| > £ ) °- 

6=1 



(5.23) 



We establish the preceding relation in a similar way we established ( 15.18l) of 
part (a), on noting that the proof here will be done via conditioning on the 
sample. Before establishing the details, it is important to note that, via 
conditioning on the sample, T^ n (b) and T^ n (b') are independent for each 
1 < b ^ b' < B. We have 



6=1 



1 B 
6=1 

E { P (b E l J ( T ^,.( fe ) — °0 $ («)| > e\X)} 

6=1 



6=1 

+ E ^[(TC„„(&)<a)-$(a)) (/(T^ iM (6')<a)-$(a))|x]} 

1<6^6'<B 

" £ + E { { P ^A l ) < a \ X )~ (P(T^(2) <a\X)- d>(a)) } 

— )■ 0, as n, m n , B — > oo. 

The preceding relation is true due to the fact that , as n, m n — > oo, 
P( T m n ,» - a |^) $ ( a ) ^ n probability - P x 
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and the dominated convergence theorem. Now the proof of (I5.23P and, con- 
sequently that of parts (b) and (c) are complete. Hence the proof of Theorem 
14.11 is also complete. □ 



Proof of Theorem 14.21 

Once again, in view of the fact that, asn-> oo, S 2 — > o~ 2 a.s. — Px we replace 
T* with T* a , which is defined by 



i=i 



„ „ := = a.s. - P f 



8=1 



The proof of this theorem essentially consists of the same steps as those of 
part (a) of Theorem 14.11 Hence, once again, the asymptotic normality of 
T* a (b), for each 1 < b < B, conclude the asymptotic conditional indepen- 
dence of T* a (b) and T* a (b') for each 1 < b ^ b' < B, from the fact that 
conditionally they are asymptotically uncorrelated. The latter is established 
in the following Lemma [5.51 



Lemma 5.5. Assume the conditions of Theorem \4-S\ As n,m n — > oo, for 
each 1 < b ^ V < B, we have that 



E[T:jb) T* >a {V) I (Ci(&), • • • , Ub)), ((x(b f ), . . . , Ub'))) -> in probability -P c . 

To prove this lemma, without loss of generality we assume that -E^(Cl) — 
0, and let E ^,b' be a short hand notation for E( .1 (Ci{b), ■ ■ ■ , Cn(&))> (Ci (^') ? • • • ? Cn{b')) 



Now, similarly to the proof of Lemma 15.51 we note that 

EILi {(i(b)-ab))((i(b)-C(b')) 



E X \ b , v {KA h ) T nAb')) 



TLi {Ub) - c(b))yEU (o(b) - my 

In view of the preceding statement, to complete the proof, with e±, £2, £3 > 0, 
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we proceed as follows: 



EILi (Ci(b)-C(b))(Ci(b')-ab')) 



ELi (C*(6)-C(6))V5:r=i (0(&) - C(&0) 

EHi fe(6) - C(6)) (6(6') - C(6')) 



> £1 



< p 
+ p 
+ p 



n 



> £i(l -£ 2 )(1 -£3^ 



ELi (C*(6)-C(6)) 



- 1 



7>. 



> £2 



ELi (a(6')-c(60)' 



1 



n 



>£ 3 ■ 



Clearly, the last two relations approach zero as n — > 00. Hence, it only re- 
mains to show the asymptotic negligibility of the first term of the preceding 
three. To do so, we let £4 := £i(l — £ 2 )(1 — £3) and apply Cheshev's inequality 
to arrive at 



p / Ei (0(6)-C(6))(0(6)-C(6Q)| ^ p \ 
P l n_ >£ V 

< efn- 2 {nE 2 {Ub) - ((b)) + n(n - 1)P 2 [(Ci(6) - C(6)) (C 2 (6) - C(6))] } 

< efn- 2 {nE 2 {(f) + n ^~ l) E 2 {C,l)} 0, as n 00. 
This completes the proof of Lemma 15.51 □ 

Due to similarity of the rest of the proof of this theorem and that of ( I5.18P 
of part (a) in the proof of Theorem I4.1[ the details are omitted. Now the 
proof of Theorem 14.21 is complete. □ 
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